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(54) Title: METHOD AND APPARATUS FOR ENCODING A USER INTERFACE 
(57) Abstract 



A method and apparatus for 
combining video frame sequences with 
a video display of an interactive program 
guide (IPG). The apparatus comprises 
a plurality of compositors that combine 
background information, video frame 
sequences and program guide graphics 
into a single video frame sequence. 
The sequence is then digitally encoded 
to form an MPEG-like bitstream. The 
same background information and 
informational video is composited with 
a different program guide graphic to 
form another video sequence that is also 
encoded. A plurality of such sequences 
are produced with each sequence having 
a different program guide graphic. 
Each sequence is encoded and then 
multiplexed into a transport stream 
such that all the encoded sequences are 
transmitted to a subscriber's terminal 
using a single transport stream. As 
such, the subscriber can transit from 
one program guide to the next without 
interruption of the background or video 
display as the program guide graphic is 
changed. 
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METHOD AND APPARATUS FOR ENCODING A USER INTERFACE 

CROSS REFERENCE TO RELATED APPLICATIONS 

5 This application claims benefit of U.S. provisional 

patent application serial number 60/093,891 filed July 23, 
1998 which is hereby incorporated herein by reference. This 
application is also a continuation-in-part of commonly 
assigned U.S. Patent Application serial number 09/293,526 
10 filed April 15, 1999 and commonly assigned U.S. Patent 
Application serial number 09/201,528 filed November 30, ' 
1998, both of which are hereby incorporated herein by 
reference . 

15 BACKGROUND OF THE DISCLOSURE 

1. Field of the Invention 

The invention relates to electronic program guides and, 
more particularly, the invention relates to a technique for 
20 encoding a user interface of an information distribution 
system. 

2. Description of the Background Art 

25 In several communications systems, the data to be 

transmitted is compressed so that the available transmission 
bandwidth is used more efficiently. For example, the Moving 
Pictures Experts Group (MPEG) has promulgated several 
standards relating to digital data delivery systems. The 

3 0 first, known as MPEG-1 refers to ISO/IEC standards 11172 and 
is incorporated herein by reference. The second, known as 
MPEG-2, refers to ISO/IEC standards 13818 and is also 
incorporated herein by reference. A compressed digital 
video system is described in the Advanced Television Systems 

35 Committee (ATSC) digital television standard document A/53, 
and is incorporated herein by reference. 

The above-referenced standards describe data 
processing and manipulation techniques that are well suited 
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^ delivery of video, audio and other 
to the compression and delivery ... 

*i or- variable rate digital 
information using fixed o ab ova-ref erenced 
communications systems. In particular, whniciuea 
standards, and other "MPEG- like" standards and techniques, 
(narratively, video information using 
5 "ame ^ ^ 5 ( suc h as run-length coding, 

j *->^ iiVp^ and inter-frame coding 
Huffman coding and the HKe) ana 

m otion compensation and the like) - Specifically, in the 
L0 7ase of video processing systems, MPEG and MPEG-like video 
Recessing system are characterized by ^^"J^ 
compression encoding of video frames with or without intra 
and/ or inter-frame motion compensation encoding. 

Over the past few years, television has seen a 
15 transformation in a variety of means by which its 
15 transform ,. tributed to consumers. Cable television 

Ts" ling er even tripling system bandwidtl . wit, 
Xe migration to hybrid fiber coax ,HrC cable plant thereby 
offering a larger number of channels to the viewer. 
2 „ customers unsatisfied with their local cable system ,^ave 

switched in high numbers to direct broadcast satellite (DBS) 
systems. And, a variety of other approaches have been 
attempted focusing primarily on high bandwidth 
technologies, intelligent two way set top ^J*^ 
25 methods of trying to offer service differentiated from 
standard cable and over the air broadcast systems 

With this increase in bandwidth, the number of 
programming choices has also increased. Leveraging off 
^variability of more intelligent set top boxes, several 
30 complies such as Starsight and Prevue Guide have developed 
ellorate systems for providing an interactive listing of a 
vast array of channel offerings, expanded textual 
information about individual programs, the ability to loo, 
f^ard to plan television viewing as much as several weets 
35 in advance, and the option of automatically programing a 
VCR to record a future broadcast of a television program. 

unfortunately, the existing program guides have several 
drawback. They tend to require a lot of memory, some of 
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them needing upwards of one megabyte of set top terminal 
(STT) memory. They are very slow to acquire their current 
database when they are activated for the first time or are 
subsequently restarted (e.g., a large database may be 
5 downloaded to a STT using only a vertical blanking interval 
(VBI) data insertion technique) . Disadvantageous ly, such 
slow database acquisition may result in out of date database 
information or, in the case of a pay per view (PPV) or 
video-on-demand (VOD) system, limited scheduling flexibility 
10 for the information provider. The user interface to 

existing program guides does not usually look like a typical 
television control interface; rather looks like a 1980's 
style computer display (i.e., blocky, ill-formed text and/or 
graphics) . 

15 Additionally, the present program guides may provide an 

advertising or preview region along with the program guide 
graphics. However, the insertion of these additional video 
signals is performed using an analog compositor that merely 
inserts (overlays) the additional imagery into the broadcast 

2 0 stream. The analog compositing process is accomplished and 
then the new analog video containing an advertisement or 
preview and the program guide are recorded on tape for 
subsequent broadcast. This compositing process is not 
accomplished in real time at the head end of the cable 

2 5 system and, consequently, the program guide can not contain 
targeted advertising for a particular household or a 
particular neighborhood or region. The program guide with 
its associated preview or advertising is broadcast to all 
subscribers connected to the head end of the cable system. 

30 Additionally, these program guides are generally passive, in 
that, the viewer sees the program guide information change 
on the screen to indicate different programs and their 
associated channels. However, there is no provision 
enabling a viewer to interact with the program guide display 

35 to scroll through the channel or channels that are 

available. Because such scrolling in an analog system 
requires a splice to a new program guide video sequence, the 
program guides that are interactive do not include 
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advertising video or other video information with the 

^^^ereftre, it is desirable to provide a method and 
apparatus for encoding an interactive program guxde. 

5 

CTTMMARY OF TTJVBNTION 

The disadvantages associated with the prior art are 
overcome by the present invention of a method and apparatus 
overcome y f an info rmation distribution 

10 for encoding user interface or 

system. One embodiment of such user interface xs an 
interactive program guide ( IPG) that forms an IPG screens 
^ g e containing a graphical guide region and a 
playing at least one video sequence. The inventxon xs a 
15 Lid and apparatus for performing ensemble encodxn, . of one 
or more IPG pages. The invention comprxses a plurality of 
compositors that combine background information 
informational video and program guide graphics xnto a single 
sequence of video frames. The sequence is then dually 
20 encoded to form an H«-lil» bitstream. The same background 
information and informational video is composxted with 
different program guide graphic to form another video 
sequence that is also encoded. A plurality of such 
bitstreams are produced with, each sequence containing . 

««, miide araphic. The encoding xs performed 
25 different program guxde grapmt- _ 

using a c«-o» coding profile and a common clock for each of 
the encoders. The encoded sequences are then multiplexed 
into at least one transport stream such that all the encoded 
sequences are transmitted to subscriber equipment using one 
30 or more transport streams. As such, the subscriber can 
transition from one program guide page to the 
interruption of the background or informational video as the 
program guide page graphic is changed. 

The informational video may appear in multiple 
35 locations upon the !PG screen. Promotional or advertising 
video may appear in one portion while an animated graphic 
appears in another location. Each of the informational 
video streams may have a different rate of display. The 
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encoders handle different video rates by using slice based 
encoding of the composite image sequence. 

One example of a program guide that is encoded in 
accordance with the invention has each graphic containing a 
5 set of programs (e.g., channels) listed along a left, 

vertical axis and each program associated with the channel 
is identified in a rectangular cell that extends toward the 
right. The horizontal axis represents time and about 1.5 
hour of programming for ten channels is shown in each 
10 program guide graphic page. The informational video is 

generally contained in one or more regions above the program 
graphic . 

In another example of a program guide that is encoded 
in accordance with the invention has each graphic containing 

15 a set of programs (e.g., channels) listed along a left, 

vertical axis and each program associated with the channel 
is identified in a cell that is listed beneath a time axis. 
The horizontal axis represents time and about 1.5 hours of 
programming for eight channels is shown in each program 

20 guide graphic page. Each channel is associated with text 
that represents three programming slots, one for each half 
hour in the time axis . The informational video is generally 
contained in one or more regions next to the program 
graphic, i.e., a guide region is on the left half of the 

2 5 screen and the video region is on the right half of the 

screen or vice versa . 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 The teachings of the present invention can be readily 

understood by considering the following detailed description 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-level block diagram of an 
information distribution system that uses the interactive 

3 5 program guide of the present invention; 

FIG. 2 depicts a block diagram of an IPG generator of 
the present invention; 



BNSDOCID: <WO 0005890A1 J_> 



PCT/US99/16265 

WO 00/05890 _6_ 

F T G 3 depict, a block diagram of a compositor unit 
that price, Lkground, informational frame sequence in 

-nat inserts an IPG graphic into the 

FIG. bA 3«- ««y that . can 

FIG. 6 depicts another example of an IPG p g 

oe produced by the invention; and 

FIG. 7 depicts a PID map for a set of IPG pag 

^ "t;~;:'te understanding, identical reference 
numerals have been used, where possible, 
identical events that are common to the f.gures. 

nr , dec>i cts a high-level block diagram of an 
FIG. 1 depicts * _ v ideo-on-demand 

information distribution system 100 
!0 system or digital cable syst^. ^ ™ ^ provider 
present in,»uo. The syst ^ _ aistribution 

egul pment SPB, 102 <^ g networ k, and subscriber 

" „t U> loi This form of information distribution 

equipment <SE> 106 ^ patent 

" SYS i e ltIon serial number 08/984.710 filed December 3. 1997. 
Te systel is kno^ as the OnSet™ system provided by r>XV* 
systems corporation of Henlo Park <*™<™£ of digital 
m general, the SPE 102 produces a plurality 
► T,«f r-ontain encoded information (e.g.. 

^ese bitstrels are modulated using a modulation format 
Tat is compatible with the. distribution network 104^ T 
subscriber equipment 106, at each subscriber 
35 106 2 106.. comprises a demodulator /decoder 124 and a 

*• i v 126 Upon receiving a bitstream, the subscriber 
dxsplay 126. Upon information from the 

equipment decoder 124 extracts 
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received signal and decodes the stream to produce the 
information on the display, i.e., produce a television 
program or program guide page . 

In an interactive information distribution system such 
as the one described in commonly assigned U.S. patent 
application 08/984,710, filed December 3, 1997, the program 
bitstreams are addressed to particular subscriber equipment 
locations, that requested the information through an 
interactive menu. An appropriate interactive menu structure 
for requesting video on demand is disclosed in commonly 
assigned U.S. patent application serial number 08/984,427, 
liied December 3, 1997. 

To assist a subscriber (or other viewer) in selecting 
programming, the SPE 102 produces a interactive program 
guide (IPG) in accordance with the present invention. The 
IPG of the present invention contains program information, 
e.g., title, time, channel, program duration and the like, 
as well at least one region displaying full motion. video, 
i.e., a television advertisement or promotion. Such 
0 informational video is provided in various locations within 
the program guide screen. 

FIG. 5A illustrates a first example of an IPG 500 that 
is produced in accordance with the present invention. The 
IPG 500 contains a background 502, a plurality of video 
5 display regions 504, 506, and 508, and a program guide 

graphic 510. The program guide graphic 510 contains a left 
(or right) , vertical axis 512 representing the available 
channels and a bottom (or top) , horizontal axis 514 
represents time. Generally, about 1.5 to 2 hours of 
0 programming are displayed in the guide graphic 510. Each 
program (e.g., PI, P2, P3 , and so on) is identified by a 
program title within a rectangular cell . The extent of the 
cell (its length) indicates the duration of the program and 
the starting location of the left edge of the cell, indicates 
5 the starting time of the program. The arrangement of the 
program identification cells in this manner is a 
conventional arrangement in which programming guides have 
been organized in print for years. 
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Ketuming to FIG. 1. invention produce, the IPG 

,500 of FIG. 5A, using a novel compositing ~ ^ 
enables full motion video to be positioned within an 

tL video seamlessly transition ^ ^J^^ 
mother FIG. 1 depicts the components that are neces ry 
To Produce an IPG page that contains at least one video 
region The embodiment of the invention is described 
hiving' advertising displayed in the video region or regions, 
navxny c*a , n „^ a H^ of a type of 



However advertising is merely illustrative of a type of 

the SPE 102 contains a video storage device 108. an 
informational video selection and monitoring system 110. 

ensemble encoder), a background 

^device "ts a controller 114. an IPG grid generator 
15 storage device ll». •» Tlie video selection 

120. and a digital video modulator 122. The vide 
and monitoring system 110 controls timing of the 
informational video display and. if the video i an 
advertisement, tracks video utilization to fa «^ate 
billing to an advertiser whenever a particular advertisement 
t fitted. Thus, the video selection and «~««^ 

nn reouests that the storage device 108 (e.g.. a 
Sriite oI mtgneto-optical drive, recall and send to the 
^ ^ Mrator lie a particular video ^e, ,ce The^ideo is 
stored in the storage device 108 as ^'^J^ 

•fl.o (i e 601 format video) and associated audio, 
video (i.e.. 60 ^compressed analog video as 

Alternatively, compressed f =t -„-<,d in 

well as other formats of video information may be stored in 
tne storage device 108. These formats are converted to 601 
oUt prior to sending the video to the IPC . generator 116 . 

As the video is recalled from device 108, each video 
sequence is coupled to the IPG generator 116. As such 
tn«e video streams and one audio stream (e.g. , an audio 
stream associated with one of the advertisements, are 
5 pro vided to the IPG generator 116. -itional ^ ^ 

^ge is generally a static graphic, but it may be a video 
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frame sequence containing moving imagery. Lastly, the IPG 
grid generator 120 provides a program guide graphic to the 
IPG generator 116. The IPG data for the graphic can be 
provided from any one of a number of sources such as a 
5 network cable feed, an internet site, a satellite feed, and 
the like. The guide program data is formatted, for example, 
into the rectangular grid graphic of program cells (screen 
500 of FIG. 5A) by the IPG grid generator 120. As shall be 
discussed below with respect to FIG. 6, other IPG page 

10 layouts may be used and are considered to be within the 
scope of this invention. 

The IPG generator 116 performs ensemble encoding by 
combining the three video sequences, the background and the 
guide graphics into a comprehensive IPG display such as the 

15 one depicted as IPG page 500 in FIG. 5A or IPG page 600 in 
FIG. 6. As shall be described in detail below, the 
informational video is overlaid onto the background to form 
a background/video composite and then various IPG grids are 
overlaid upon the background/video composite. In this 

20 manner, a number of IPG n pages", for example, fifteen of 

them, are produced, where each page depicts ten channels of 
programming information. Each of these IPG pages is encoded 
within the IPG generator 116 into a compressed digital 
bitstream, e.g., an MPEG compliant bitstream. The bitstream 

25 is then modulated by the digital video modulator 122 using a 
modulation format that is compatible with the distribution 
network 104. For example, in the OnSet™ system the 
modulation is quadrature amplitude modulation (QAM) ; 
however, other modulation formats could be used. 

30 The subscriber equipment 106 contains a 

demodulator/decoder 124 and a display 126 (e.g. , a 
television) . The demodulator/decoder 124 demodulates the 
signals carried by the distribution network 104 and decodes 
the demodulated signals to extract the IPG pages from the 

3 5 bitstream. As shall be described below, each of the IPG 
pages is identified with a unique program identification 
code (known as a PID) that is used by the 

demodulator/decoder 124 to select a bitstream for decoding. 
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The decoded IPG page is displayed, as shown in FIG. 5A, to 
the subscriber or viewer. As the viewer selects another IPG 
page containing other program information, generally by 
scrolling to the bottom of the IPG graphic 510 using a 
remote control interface 128 or some other input device, the 
IPG page stream associated with the next PID is decoded. 
The only change the viewer sees is the IPG graphic changes 
(from, for example, graphic 510, to 5lO a ) , the informational 
video and its associated audio seamlessly continues playing, 
-his seamless play occurs because each of the IPG pages 
contains the same, frame synchronized background and 
informational video and only the IPG graphic changes from 
page to page. As such, the decoder seamlessly transitions 
'rom one IPG page to another, 
m * FIG 2 depicts a block diagram of the IPG generator 
-i6 The IPG generator 116 contains a compositor unit 
I Plurality of IPG grid compositors 202, a plurality of 
v<deo encoders 204 (e.g., MPEG-2 compliant encoders), a 
coxrmon profile and clock generator 250, a transport stream 
20 multiplexer 206, an audio delay 208, an audio encoder 210 
(e g an Dolby AC -3 audio encoder) and the IPG grid 
generator 120. The compositor unit 200 positions the 
informational video sequences (vs2 , vs3 , vs4) upon the 
background video imagery (vsl) . To facilitate positioning, 
the controller (114 in FIG. 1) provides the compositor unit 
200 with the coordinates of one corner of each informational 
video and provides a size indicator for each rectangular 
region in which the video will be displayed relative to the 
background. The compositor unit 200 performs the placement 
30 and fusing of the imagery to form background/ informal 
video frame sequence. Further detail of this composing 
process is provided below with respect to FIG. 3. 

The composite image (e.g., three, full motion video 
frame sequences positioned upon a background image, the 
3 5 background/ informational video) is coupled to a plurality of 

ono 9D9 202 , 202,. (collectively 
IPG grid compositors 202,, 2U2 2 , zuz 2 , .... 15 

referred to as compositors 202) . The compositors 202 
combine the respective IPG graphics with the 
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background/ informational video combination to produce a 
plurality of video frame sequences containing a composite of 
the background, the informational video, and the IPG 
graphics. There is one frame sequence for each IPG graphic, 
e.g., fifteen sequences in all. As discussed previously, 
the IPG graphic is produced by the IPG grid generator 120. 
The IPG grid generator 120 actually produces two items, one 
is the IPG grid background image (the IPG grid graphic 
discussed above and shown as graphic 510 in FIG. 5A) , and 
IPG grid foreground overlay graphic data that is used to 
generate highlighting and other special effects in the 
displayed IPG screen. Additionally, this data attributes 
functionality to the highlighted elements such as selecting 
another IPG page, selecting a program to view, exiting the 
system, and the like. These special effects and 
functionality are discussed below with respect to FIGS. 5A, 
5B and 5C . 

Each of the frame sequences (IPG screen sequences VI, 

V2 , V3 , V15) are coupled from the compositors 202 to the 

plurality of video encoders, e.g., real time MPEG-2 encoders 

204 x , 204 2 , 204 3 , ... 204 n (collectively encoders 204). Each 

encoder 2 04 encodes an IPG screen sequence to form a 
compressed video bitstream, e.g., an MPEG-2 compliant 
bitstream. The encoders use a common encoding profile and 
common clock supplied by the encoding profile and clock 
generator 250. As such, each sequence of IPG frames are 
synchronously encoded in the same manner. 

The IPG grid foreground overlay graphics data is also 
coupled to the multiplexer 206 from the IPG grid generator 
120. This graphics data is generally sent as "user data" or 
"private data" within the transport stream. Further 
discussion of the graphics data is provided below. 

If the informational video in each IPG page have 
differing amounts of motion, the encoders can encode the 
video in a slice-based manner. As such, each frame is 
divided into a plurality of horizontal stripes of 
macroblocks . Each frame contains stripe start and stop 
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•„ ,i fiers The information (pixels ana/or macroblocks ) 
^n "e sterr ana stop identifiers can * - a 

different manner than other portions of a given stripe 
, a two dimensional region comprising portions 

its own program identifier, n 

the demodulator/decoder decodes the information in each 
slice then reassembles the frame by placing the 
flices into appropriate locations as identified by the slice 
start s-P identifiers. The two dimensions regions can be 
specified to align with the inf ormationa! video such that 
Z regions can contain video having different motion i. e . , 
fast versus slow motion. Conseguently . one region could 
, tasc ver^u ,, racter while another 

„ nn ^ in a s iow moving animated character wnn 
Z on did contain a fast moving sporting event promotion 
and both regions would be coded and decoded . 

All the compressed video streams (El. E2. E3 

information are multiplexed into a 

0 containing program ^ ld * X f ° ^ These com pressed 

transport stream ""V^^.^ encoded streams 
video streams may contain the stripe u 

.11 m addition to the video information, audio 
as well. in additi inf orma tional videos 

information associated with one of the i 
> 5 is also encoded and supplied to the multiplexer 206. The 
15 audio signal is delayed in audio delay ,03 

j om The delay compensates for the time 
the audio encoder 210. ine aei^ r 

reared to perform video encoding of the associated ^video 
vJ-a-vis the audio encoding. The compressed audio data is 
30 coupled to the multiplexer 206 for incorporation into the 

" a T"a™- stream, as defined in *SO standard 13*13 1 

o MPEG-2 Systems specification) , is a 

r-i^r^rsredTc^ - „. T:t ^ 

35 Each packet has a 4-byte header and 184 bytes of data, 
header contains a number of fields, including packet 
Verification number (PID). The PID field contains 13 bits 
^a uniguely iaentifies each packet that contains a portion 
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of a "stream" of video information as well as audio 
information and data. As such, to decode a particular video 
bitstream (or audio bitstream or data) for viewing, the 
decoder in the subscriber equipment extracts packets 
5 containing a particular PID and decodes those packets to 
create the video (and audio) for viewing. 

Each of the fifteen bitstreams representing the IPG 
page sequences within a particular transport stream are 
uniquely identified by a PID. In the preferred embodiment, 

10 fifteen PID's are multiplexed into a single transport 
stream. Certainly, less of more IPG bitstreams can be 
included in a transport stream as bandwidth permits. 
Additionally, more than one transport stream can be used to 
transmit the IPG bitstreams. For example, additional IPG 

15 pages may be encoded that represent additional time within a 
day or additional channels. The bitstreams representing the 
additional IPG. pages are transmitted in additional transport 
streams. As such, many IPG pages representing 24 hours of 
programming on hundreds of channels can be broadcast to the 

2 0 subscriber equipment for selective display to a viewer. 

FIG. 7 . depicts a graphical representation of PID 
assignment to each IPG page. The graph 700 contains a PID 
axis 702 and a time axis 704. At time 1 (tl) and, more than 
likely, within a single transport stream, the graphics 706 

2 5 for a first IPG page and the video 708 for a first IPG page 

are sent in PID1 . Then, in PID2 , the graphics 710 for a 
second IPG page and the video 708 for the second IPG page 
are sent. Note that the video is the same in each IPG page 
that is sent at time 1 and only the graphics (g 1# g 2 ».g 15 ) 

3 0 change from IPG page to IPG page. The change in graphics 

may represent either different time intervals or different 
channel groupings shown in the IPG pages . In time 2 , the 
grouping and encoding is repeated using different video. 
The process is repeated until all the IPG pages are 
3 5 generated to cover all available channels over a 24 hour 
period. The transport streams carrying the encoded IPG 
pages are then broadcast to all viewers. 
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An exemplary transport stream consist of » Pro.ra.ns 
multiplexed together into one ™°« ™ " J^L MpEG 
program has if. own video J-;^— r share the 
bits for a single guide page. All tne p 

5 same audio and PCR- reouired to switch 

To change pages in the guide, it is require 

«, (video PIDs) in a seamless manner. This 

v, a1f - cpcond blank screen, 
gives halt a seconu . cn1irp countdown 

To have seamless decoder sw.tch.ng, a splrce co 
,or random access indicator, method xs employed at the en 
of each video se^ence to indicate the pornt at whrch 

•*-^>,^ from one P ID to another. 

^- „^ the generated streams for different IPG 
resTeTrmrdln I^ilar length compared to each other, 

v. hhat the source material is almost 

20 1^*-^^ «- characters in the guide from 
20 identi her In this way, while streams are 

rne^inTir^ths, the, are not exactly the same 

-i^ for- anv give sequence of 15 viaeo 
1priat hs For example, tor any y"<= 

lengths. t packets in the sequence 

frames, the number of transport p ^ 
25 varies from one guide page to another. Thus a finer 

ad ustment is required to synchronize the ^^J^ 

^ anrnss all guide pages m order xor 
ends of each sequence across an y 

the countdown switching to work. of a 

Th e invention provides the act of ^chronrzatron of a 
plurality of stream that provides seamless sw.tchmg 



30 

STT 



Three methods are provided for that purpose: 

First for each sequence you can count the longest 

.v-. ^articular sequence, and then add 
guide page f „ : tha .part c ^ ^ ^ 

sufficient null pacKets uu 

so that all the guide pages become the same lengths^ Then 
add the switching pacxets at the end of the sequence, after 
all the null packets. 



BNSDOCID <WO 000S890A1J_> 



WO 00/05890 



-15- 



PCT/US99/16265 



The second method . requires buffering of all the packets 
for all guide pages for each sequence. If this is allowed 
in the considered system, then the packets can be ordered in 
the transport stream such that the packets for each guide 
5 page appear at slightly higher or lower frequencies, so that 
they all finish at the same point. Then the switching 
packets are added at the end of each stream without the null 
padding . 

A third method is to start each sequence together, and 
10 then wait until all the packets for all the guide pages have 
been generated. Once the generation of all packets is 
completed, switching packets are placed in the streams at 
the same time and point in each stream. 

Depending on the implementation of STT decoder units 
15 and requirements of the considered application, each one of 
the methods can be applied with advantages. For example, 
the first method, which is null-padding, can be applied to 
avoid bursts of N packets of the same PID into a decoder's 
video buffer faster than the MPEG specified rate (e.g., 1.5 
20 Mbit) . 

The same principles of splicing and synchronization 
techniques are applicable to a plurality of different 
transport stream forms, including recombinant stream. 
The teachings of the above three methods can be 
25 extended apply to similar synchronization problems and to 
derive similar methods. 

Returning to FIG. 1, the transport stream is coupled to 
a digital video modulator 12 6 where it is modulated onto a 
carrier that is appropriate for transmission through the 
30 distribution network 104. For a hybrid fiber coax based 
distribution network 104, the modulation is quadrature 
amplitude modulation (QAM) . 

The subscriber equipment 106 is connected to the 
network 104 and receives the transport stream from the 
35 network 104. A demodulator /decoder 124 in each of the 

terminals extracts the transport stream from the modulation, 
demultiplexes the bitstreams within the transport stream, 
and decodes a selected program guide video sequence. Since 



BNSDOCID: <WO 0005890A1 J_> 



10 



15 



PCT/US99/16265 

WO 00/05890 _ 16 _ 

hitstreams are contained in the transport 
the program guxde bitstreamt, 

demodulator/decoder 124 to decode the P™^ 1 ^ of 
bitstream identified by that PID (or PIDs in the case 
slice based encoding, . when the use, selects 
1„ M ^de, another stream is decoded based upon the 
^elected PXP or PX D s . By transmitting many P™*:- 
auide streams in a common transport stream and by frame 
TcWno the program guide source, encoding and decoding 
"roc sses, the latency experienced as a --^jtelluse 
Le guide page after another is undetectable. Also, because 
Z informational video is the same and frame synchronised 
i„ each program guide bitstream with the only deference 
being a different guide graphic, the subscriber sees a 
fr uition in the guide graphic, but the informational audio 
and video is seamlessly presented to the viewer 

FIG 3 depicts a detailed block diagram of the 
expositor unit 20, , The ^"and 

"sumed to be supplied as a conventional pixilated video ^ 
5 signal in a 601 format (digital video, having each frame 
6ot video synchronized with the frames of the other 
advertisement video signals. Generally. 601 video « 
supplied as a serial bitstream that is converted into 
grille! stream, i.e.. one complete video frame is coupled 
30 to the compositor at a time. 

More specifically, the background imagery vsl and the 
£ irst informational video vs2 are coupled - the ser-l-to- 
parallel converter module 300. The frames of each of these 
Xideo signals are then coupled to the composite 30^ 
35 operation, the compositor 302 synchronizes the ^ames 

resizes the informational video to fit into a predefined 
rectangular region, positions the rectangular region on the 
background and merges the two video frame sequences. The 
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controller 114 of FIG. 1 uses the PCI bus 312 to instruct 
the compositor as to the size of the informational video 
region and its position on the background. A commercially 
available compositor is used to perform the foregoing 
5 operations using 601 video signals. 

The composited video sequence containing the background 
and first informational video is then coupled to the second 
compositor 306 such that the second informational video is 
composited onto the background and first video. The third 

10 compositor 3 08 performs a similar function to produce a 

frame sequence having the background and three informational 
video sequences composited into a single sequence. The size 
and position of the informational video display regions is 
controlled by signals from the controller via the PCI bus 

15 312. The output sequence from the third compositor 308 is 
optionally coupled to the parallel- to-serial converter 
module 310 to produce a serial bitstream. Generally, the 
parallel data is coupled directly to the IPG grid 
compositors (202 in FIG . 2); however, if the compositor unit 

20 200 is not physically near the compositors 2 02, then the 

parallel- to- serial converter 310 may be used to improve the 
integrity of the data as it is communicated over a distance. 
Although only three informational videos were added to the 
background using three compositors, clearly more compositoris 

25 can be used if additional informational video sequences are 
desired. 

FIG. 4 depicts a block diagram of one of the IPG grid 
compositors 202, e.g., compositor 202^ The compositor 202 x 
contains an alpha framestore 400, a video framestore 402 and 

30 a compositor 406. The alpha framestore 402 stores a bitmap 
array of weighting functions that control the degree of 
transparency that the IPG grid will have with respect to the 
background/ informational frame sequence, i.e., the bitmap 
contains a value of transparency for each and every pixel in 

35 the IPG graphic. As such, the alpha framestore information 
controls the amount of background/ advertising video scene 
that can be viewed "through" the IPG graphic. The video 
frame store 402 buffers the IPG graphic on a frame -by- frame 
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basis to ensure alignment with * ^-o^n^tior.1 
video frames. The compositor 406 combines the IPG grap 
wit h the ground/informational frames P^^^JTt t^ 
.mpositor --00 in ro . 

5 Ta fhe^rr^ coupied to the compositor ,0, by the 

controller 114 of FIG. 1- fifte en, are separately 

Each of the IPG graphics, e.g., fifteen J 

comPO site d in r::r -- -r"—^ 

transport = »eam. illustrative IPG page layout 

FIG. 5A. depicts a tirsu i-l-ll^ 
500 as decoded by the decoder of the subscriber ecaipment . 
15 I 1 page BOO. is one of the fifteen ^^J^^ ^ 
(collectively referred to as IPG pages 500) that can be 
(collect y se i e ction of a screen PID within a 

decoded by appropriate selection decoded 

c -_ nar tpg screens can be also decoaea 
t-ransDort stream. Similar xrvj ;=><- 

froTother transport streams that are broadcast to the 

• ^t- from the head end equipment. as 

flavs as any decoded video streams. The audro srgnal 
Isolated with one of the informational vi^o — 

a lso is decoded and plays in conjunction wrth the vrdeo 
25 n . audio follows video) . The first IPG graphrc 510 

contains for example, program information concerns 

c™s 1 through 10. The subscriber, by ^ 
A ran scroll through the program selections. As 

r 'sctTllng function transitions from one cell to another 
3„ the cell Is Z£Z ' 

gr aphics. These ^-^r a r/or private data- within the 

™ T tailed "ascription of the operation 
ofTe IPG Hs presented in co^only assigned US patent 
ot tne ir filed simultaneously 

incorporated by reference. 
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When the subscriber reaches the bottom of the IPG 
graphic, i.e., the last cell or a special icon (arrow), a 
different PID is selected for decoding, i.e., the PID for 
the next IPG page containing channels 11 through 20. The 
5 decoder begins decoding the next stream as soon as it is 
selected. The connection between IPG pages is a functional 
attribute that is generally transmitted to the subscriber 
equipment as user data within the transport stream. Since 
the background and the informational video were 
10 synchronously added to the video sequence that become the 
IPG pages, the informational video seamlessly transitions 
from one screen to another without any visible anomalies. 
The IPG graphic is the only portion that changes from 510 1 to 
510 2 . The process of transitioning from one IPG page to 
15 another can be accomplished by incrementing or decrementing 
through the IPG pages. Additionally, parallel pages, may be 
available to display additional time slots. As such, IPG 
pages representing programming in other time periods could 
be accessed by, for example, left and right arrows . These 
20 parallel pages may be carried in additional transport 
streams or in the same transport stream. 

A second illustrative IPG page layout 600 is shown in 
FIG. 6. This IPG page layout is encoded in the exact same 
manner as the layout 500 of FIGS. 5A-5C. The IPG of FIG. 6 
25 operates in a similar manner to that of IPG layout 500. The 
layout 600 is divided vertically such that the informational 
video, e.g., a video barker, appears on the right half of 
the layout and the guide region appears on the left. The 
guide graphics, graphical icons, background imagery, and 
3 0 informational video are combined and then encoded in the 
same manner as discussed above. A detailed description of 
the IPG 600 is presented in commonly assigned US patent 

application / filed simultaneously 

herewith (Attorney docket number 070 CIP2) and herein 
35 incorporated by reference. 

Although the foregoing description illustratively 
disclosed encoding an IPG page, the invention finds use in 
encoding any form of mixed graphical and video information 
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information. Selecting the video region would 
enlarge the video to the entire screen, while selects a 
7ZZ t^le in the program guide may initiate a preview 
video to play in second video window. As such, the 
10 invention should he interpreted as encon, P—"«f^ 
combination of video and graphics that is enc oded as^ 
distal bit stream and broadcast from a head end of an 
information distribution system. „,..■>„«, 
Although various embodiments which incorporate the 
XS teaching of the present invention have been shown and 
described in detail herein, those sailed in the ar . can 
readily devise many other varied embodiments that still 
incorporate these teachings. 
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What is claimed is: 

1. A method of producing an encoded user interface 
comprising : 

5 producing a video frame sequence representing an 

interactive program guide; 

encoding said video frame sequence within a head end of 
an information distribution system. 

10 2. The method of claim 1 wherein said producing step 
comprises as step of: 

combining, in a frame synchronized manner, background 
imagery with at least one video sequence and at least one 
graphic containing program guide information to form said 

15 video frame sequence. 

3. The method of claim. 2 wherein said encoding step further 
comprises the step of: 

encoding the composited frame sequence to compress 
20 information therein to form a digital bitstream. 

4. The method of claim 2 wherein the combining step further 
comprises : 

compositing, frame-by- frame, at least one video 
25 sequence onto said background imagery to form a background 
sequence ; and 

compositing a plurality of program guide graphics onto 
said background sequence, where a different program guide 
graphic is composited onto said background sequence to form 
3 0 a plurality of program guide frame sequences that represent 
individual program guide pages . 

5. The method of claim 4 wherein said encoding step further 
comprises: 

3 5 separately encoding each of said program guide frame 

sequences to form a digital bitstream for each of the 
program guide frame sequences . 
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6 The method o£ claim 5 further comprising the steps of. 
multiplexing each of the digital bitstreams into a common 

transport stream. 

•7 The method o£ claim 6 wherein fifteen program guide 
sequences are formed, encoded, and contained in a common 
transport stream. 

F, The method of claim 5 further comprising: 

encoding an audio signal associated with one of the 

video sequences; and 

multiplexing the encoded audio signal into the common 

transport stream. 

The method o£ claim 1 wherein the video frame sequence 

ii: a television program. 

10 . The method of claim 1 wherein the video frame sequence 
is an advertising program. 
0 u. The method of claim 1 wherein the video frame sequence 
is encoded using slice based encoding. 

X , The method of claim 11 wherein slice based encoding 
5 encodes different regions in a different manner than the 
encoding that is performed upon other portrons of the video 

frame sequence. 

13 . The method of claim 12 wherein each region is assigned 
30 a unique program identifier. 

14 . The method of claim 8 wherein said multiplexing step 
further comprises the step of: 

multiplexing foreground program guide data xnto said 

3 5 common transport stream. 

15 . Apparatus for producing an encoded user interface 
comprising: 
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a compositor for producing a frame sequence 
representing an interactive program guide ; 

an encoder, coupled to said compositor and located 
within a head end of an information distribution system, for 
encoding said frame sequences to form a bitstream. 

16. The apparatus of claim 15 wherein said compositor 
produces a plurality of frame sequences and said encoder 
comprises a plurality of encoders for encoding each frame 
sequence in said plurality of frame sequences to form a 
plurality of bitstreams. 

17. The apparatus of claim 16 further comprising 

a multiplexer for multiplexing said plurality of 
bitstreams into a transport stream. 

18. The apparatus of claim 17 wherein said multiplexer 
assigns a different identification code to each said 
bitstream. 

19. The apparatus of claim 17 further comprising a program 
guide graphics generator for producing said program guide 
graphics and foreground overlay graphics, where said 
foreground overlay graphics are included into the transport 
stream as user data. 

20. The apparatus of claim 17 further comprising a program 
guide graphics generator for producing said program guide 
graphics and foreground overlay graphics, where said 
foreground overlay graphics are included into the transport 
stream as private data. 

21. The apparatus of claim 15 wherein said encoder is an 
MPEG-2 encoder. 

22. A bitstream comprising: 

a compressed video signal representing one or more 
program guide pages . 
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23 The bitstream of claim 22 wherein said compressed video 
signal is produced using an MPEG encoder. 

5 24 The bitstream of claim 22 wherein said compressed video 
signal forms a portion of a transport stream. 

25 . The bitstream of claim 24 wherein said compressed video 
signal is arranged in packets of data. 
10 26. The bitstream of claim 25 further comprising null 

packets of data. 

27. A method of encoding a plurality of program guide pages 

15 comprising the steps of: nil- stream 

encoding each program guide page to form a bitstream 

representing each program guide page; 

.determining a longest bitstream; • 
adding null packets to all bitstreams that are not the 
20 longest bitstream until all the bitstreams have the same 

length; and 

adding switching packets to each bitstream. 

28 . a method of encoding a plurality of program guide pages 

25 comprising the steps of: , .. tream 

encoding each program guide page to form a bitstream 

representing each program guide page; 

buffering all the bitstreams for all the guxde pages, 
retrieving said bitstreams from a buffer; 
30 ordering the bitstreams into a transport stream to _ 

eq uate the length of the transport stream with the length of 
other transport streams; and 

adding switching packets to the transport stream. 

35 29. A method of encoding a plurality of program guide pages 
comprising the steps of: 
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encoding each program guide page, to form a bits.tream 
representing each program guide page, where said encoding is 
started at the same time for each program guide page; 

assembling a transport stream containing each bitstream 
5 in successive order; 

adding switching packets into the transport stream 
after the bitstreams. 
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